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Abstract This paper studies the emergence of multi-stability and hysteresis in those systems that 
arise, under positive feedback, starting from monotone systems with well-dehned steady-state responses. 
Such feedback configurations appear routinely in several fields of application, and especially in biology. 
Q ' Characterizations of global stability behavior are stated in terms of easily checkable graphical conditions. 
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1 Introduction 



, Multi-stability and associated hysteresis effects form the basis of many models in molecular biology, in 
areas such as cell differentiation, development, and periodic behavior described by relaxation oscillations. 



o 
o 



I 



Q^ ■ See for instance the classic work by Delbriick [5^ , who suggested in 1948 that multi-stability could explain 
O . cell differentiation, as well as references in the current literature (e.g., |5, ^2]) ^Hji ^Sj; P^ - 

S: EH)- 

One appealing class of systems in which to study this phenomenon is that of monotone systems with 
' ' inputs and outputs, a class of systems introduced recently in [^j , motivated by applications in molecular 
biology modeling. Monotone systems with inputs and outputs constitute a natural generalization of 
classical (no inputs and outputs) monotone dynamical systems, which are those for which fiows preserve 
a suitable partial ordering on states. The work reported here is grounded upon the rich and elegant 
^ • theory of monotone dynamical systems (see the textbook by Smith |27] as well as papers such as |17M16j 
. by Hirsch and 25_^ by Smale), which provides results on generic convergence to equilibria, and, more 
generally, on the precise characterization of omega limit sets. One of the main difficulties in applying 
the theory of monotone dynamical systems is that of determining the locations and number of steady 
states. In this paper, we propose the idea of viewing more complicated systems as positive feedback 
loops involving monotone systems with inputs and outputs and well-defined steady state responses. The 
feedback configuration may induce multiple steady states, and we show how the locations and stability 
of them can be completely characterized using a simple planar graphical test. 

We present the general theory, and illustrate the results by means of two examples. The first 
is a simple two-dimensional system; since such systems can be analyzed using classical phase-plane 
techniques, the example can be related to routine and elementary calculations, and thus the meaning 
of our conditions is easy to understand. The second example is of high order, and arises in the study of 
cellular signaling cascades. Further applications are developed in the reference pQ. 

The organization of this paper is as follows. First, we review the basic definitions regarding monotone 
systems and state our main results regarding positive feedbacks. Then we present and prove several 

'Supported in part by AFOSR Grant F49620-01- 1-0063, NIH Grants ROl GM46383 and P20 GM64375, and Aventis 



1 



graphical tests which are useful in checking the properties required by our results. After this, we provide 
proofs of the main theorems as well as a number of needed technical facts concerning linear systems 
which arise when linearizing general monotone systems along trajectories. This is followed by two 
examples, as discussed above. The paper closes with a discussion of hysteresis behavior, as well as a 
subtle counterexample showing that monotonicity plays a crucial role and cannot be dispensed with as 
an assumption. Two appendixes contain proofs of some technical points. 

2 Basic Definitions 

We briefly review some of the main concepts and notations from [2]. 

By a positivity cone in a Euclidean space B we mean a nonempty closed convex and pointed 
(iiTpl —K = {0}) cone K (ZM. In this paper, we assume that cones have nonempty interiors. Associated 
to such a cone, one introduces a partial ordering: xi ^ X2 (or "2:2 ^ xi") iff X1 — X2 € K. Strict ordering 
is denoted by xi y X2, meaning that xi ^ X2 and xi X2- One also introduces a stricter ordering by 
the rule: ^ X2 xi — X2 € int(i^). A typical example is B = M" with the "NorthEast" ordering 
given by the first orthant: K = M"q, in which case "xi >z ^2" means that each coordinate of x\ is bigger 
or equal than the corresponding coordinate of X2- In this case, x\ ^ X2 means that every coordinate 
of x\ is strictly larger than the corresponding coordinate of X2-, in contrast to "xi >- X2 which means 
only that some coordinate is strictly larger. 

State-spaces for monotone systems are by definition subsets X of M", for a suitable n, and endowed 
with an order arising from a cone (or just "iC" if clear from the context). We assume always that 
X is the closure of an open subset of M". Input sets hi are subsets of ordered spaces M™, and we write 
u\ ^ U2 whenever u\ — U2 ^ where is the corresponding positivity cone in M™, for any pair of 
input values ui and U2 € U. An "input" is a locally essentially bounded Lebesgue measurable function 
u{-) : M>o — > U, and we write ui y U2 provided that ui{t) ^ U2{t) for almost all t > 0. Similarly, output 
sets y will be assumed to be ordered as well. To keep the notation simple and only when there is no 
risk of ambiguity, we use the same symbol for all orders. 

A (finite-dimensional continuous-time) system in the sense of control theory (see e.g. j3Uj ) 

X = f{x,u) , y = h{x) (1) 

is specified by a state space X, an input set U, and an output set 3^, where the map / is defined 
on X X Z//, where X is some open subset of M" which contains X. In general, one may assume that 
f{x,u) is continuous in {x,u) and locally Lipschitz continuous in x locally uniformly on n, but for 
simplicity in this paper, we will assume that f{x,u) is differentiable. In order to obtain a well-defined 
controlled dynamical system on X, we will assume that the solution x{t) = (j){t, S,, u) (or just "x(t, ^, u)") 
of x(t) = f{x{t),u{t)) with initial condition x(0) = is defined for all inputs u{-) and all times i > 0. 
This means that solutions with initial states in X must be defined for all t > (forward completeness) 
and that the set X is forward invariant. We say that the system is monotone if the following property 
holds, with respect to the orders on states and inputs: 

S,lhS,2 & ^ ^2 ^ x{t,S,i,Ui) y x{t,£,2,U2) Vt>0. 

If int(i^) 7^ 0, this is equivalent to asking: 

» ^2 & ^ n2 =^ x(t,^i,tii) > x(t,^2,'U2) Vt > 

(a set which is the closure of its interior is invariant iff its interior is invariant, see 0). We also assume 
given a monotone (xi ^ X2 ^ h{xi) >z h{x2)) output map h : X ^ y, where 3^, the set of measurement 
or output values, is a subset of some ordered space W. 







We also recall the following definition: a system is strongly monotone if: 



Cl ^ ^2 & Ui'^U2 =^ x{t,^i,Ui) x{t,^2,U2) Vt>0. 

It is often convenient to assume more about the steady-state convergence properties of a monotone 
system. The following notion, first introduced in J2j in slightly weaker form, will be useful in order to 
state our main result. 

Definition 2.1 We say that a system admits a non- degenerate input to state (I/S) static characteristic 
{■) : U ^ X if, for each constant input u ^ U, there exists a unique globally asymptotically stable 
equilibrium k^{u) and dei{Dxf{k^ {u),u)) 7^ 0. □ 

Notice that, for technical reasons, the property has been strengthened with respect to the definition 
in |2j by assuming non-degeneracy of the equilibria. For systems with non-degenerate I/S characteristic, 
we also define their input/ output (I/O) characteristic as the composition h o k-^ . 

Detecting if a system is monotone with respect to the partial order induced by some positivity 
cone K, without actually having to compute explicit trajectories of the system itself, is of course a 
very important task in order to apply our results in any specific situation. Necessary and sufficient 
differential characterizations of monotonicity are discussed in |2], where extensions to systems with 
inputs and outputs are presented of some well-known criteria previously only formulated for autonomous 
differential equations (see [Sjj). For the sake of completeness we recall the differential characterization 
proved in 2 . This characterization uses the concept of contingent cones to subsets of Euclidean spaces. 

Theorem 1 A finite- dimensional nonlinear systems of differential equations x = f{x,u) with state- 
space X and input-space lA is monotone, with respect to positivity cones K on states and on inputs, 
if and only if: 

xi >z X2 and ui h U2 =^ f{xi,ui) - /(x2,M2) G Xc^-xi^ (2) 

where T^K denotes the tangent cone to K at the point x. I 

An alternative characterization, also provided in uses a generalization (to systems with inputs) 
of the concept of quasi-monotonicity: the system is monotone if and only if 

6 ^ 6, ui hu2,C^ K*, and (CCi) = (C,6) 
^ (C,/(ei,wi)) > {CJ{a,U2)) 

(it suffices to check this property for ^1 — ^2 S dK), where K* is the set of all ^ € so that ((^, k) >0 
for all k e K. 

Orthant orders 

Any orthant K in has the form 

= {x G [ {-ly^Xi > , i = l,...,n} 

for some binary vector e = (ei, . . . E {0, 1}". Under appropriate changes of variables, one may 
often reduce the study of monotone systems to the special case in which states, inputs, and outputs are 
ordered with K = the main orthant (all = 0), i.e. to the study of cooperative systems. See [2] for 
details. 



3 Statement of Main Results 



The property defined next was studied for linear systems in jlU| . 

Definition 3.1 A system is excitable if for any initial condition ^ and any pair of inputs v, u with v y u 
for almost all t > 0, the following holds: 

x(t,C,v) :^ x{t,^,u) Vt>0. (3) 

It is weakly excitable if this is required for any pair of inputs v, u with v ^ u. □ 

The dual of excitability is also useful in the following discussion: 

Definition 3.2 A system is transparent if for each input u, and each pair of solutions ^i,n), 
x{t,(,2,u) with ^1 >- ^2 we have h{x{t,(,i,u)) ^ h{x{t,(,2,u)) for all t > 0. It is weakly transparent 
if the conclusion is that h{x{t,^i,u)) >- h{x{t,S,2,u)) for all t > 0. □ 

We prove in Section|Slthis sufficient condition for strong monotonicity of systems in unitary feedback: 

Theorem 2 Consider the unitary feedback interconnection of a system i.e. the system 

x = fix,h{x)) (4) 

resulting when we let u = y and assume that inputs and outputs are ordered with respect to the same 
positivity cone. The induced flow is strongly monotone provided that 0) be monotone, excitable and 
transparent with either excitability or transparency possibly holding in a weak sense. 

Our main result will provide a global analysis tool for systems obtained by positive feedback loops 
involving monotone systems. In 31,,, R. Thomas conjectured that the existence of at least one positive 
loop in the incidence graph is a necessary condition for the existence of multiple steady states. Proofs of 
this conjecture were given in and ^8,, under different assumptions on the system (the last 

reference provides the most general result, using a degree theory argument). However, the existence of 
positive loops is not sufficient, and our main theorem deals precisely with this question. 

The fixed points of the I/O characteristic will play a central role in the statement of the result. In 
particular, we say that a map k : U ^ U has non- degenerate fixed points if for all u gU with k{u) = u 
we have that k'{u) exists and k'{u) ^ 1. 

Theorem 3 Consider a monotone, single-input, single-output (m = p = 1, with standard order) sys- 
tem, endowed with a non- degenerate I/S and I/O static characteristic: 

X = fixu) 
y = n[x). 

Consider the unitary positive feedback interconnection u = y. Then the equilibria are in 1-1 correspon- 
dence with the fixed points of the I/O characteristic. Moreover, if k^ has non- degenerate fixed points, 
the closed-loop system is strongly monotone, and all trajectories are bounded, then for almost all initial 
conditions, solutions converge to the set of equilibria of 0) corresponding to inputs for which k^ {u) < 1 . 

This theorem is proved in Section [Tj The fact that equilibria correspond to fixed points of the 
characteristic is straightforward, but the global, and even local, stability statements are nontrivial. The 
result is particularly useful when combined with the characterization of strong monotonicity given in 
Theorem |2j 

The next Section presents several graphical tests that are very useful in checking the properties 
required by our Theorems. 
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4 Graphical Conditions for Strong Monotonicity 



For the special case of positivity orthants, i.e. when the orders in each of the input, state, and output 
spaces is defined by an orthant, criteria may be formulated in terms of the incidence graph of the system. 

Along similar lines to JH]) we associate to a given system a signed digraph, with vertices 
xi,X2 ■ ■ ■ Xn, ui,U2, ■ ■ ■ Um, 2/1; 2/2 • • • J/p and edges constructed according to the following set of rules: 

Edges betw^een x vertices: 

The graph is defined only for systems so that for any couple 1 < i,j < n of integers with i ^ j one of 
the following rules apply: 

1. If f^{x,u) is strictly increasing with respect to xj for x,u X xU then we draw a positive 
edge efj directed from vertex Xj to Xj. 

2. If P{x, u) is strictly decreasing as a function of xj for all x,u G X x U then we draw a negative 
edge e^j directed from vertex xj to Xj. 

3. Otherwise, = for all x, u and no edge from Xj to is drawn. 
Edges between u and x vertices: 

The graph is defined only for systems so that for any couple of integers i, j with 1 < i < n and 1 < j < m 
one of the following rules apply: 

1. If P{x,u) is strictly increasing as a function of Uj for sdl x,u X xU then we draw a positive 
edge directed from vertex uj to Xi. 

2. If P{x, u) is strictly decreasing as a function of uj for all x,u G X x U then we draw a negative 
edge efj directed from vertex uj to Xj. 

3. Otherwise = for all x, u and no edge from uj to x, is drawn. 
Edges betw^een x and y vertices: 

The graph is defined only for systems so that for any couple of integers i, j with 1 < i < p and 1 < j < n 
one of the following rules apply: 

1. If /i*(x) is strictly increasing as a function of xj for all x G X then we draw a positive edge e^j 
directed from vertex Xj to yi. 

2. If /i*(x) is strictly decreasing as a function of xj for all x G X then we draw a negative edge ef^ 
directed from vertex Xj to yi. 

3. Otherwise, |^ = for all x G X and no edge from Xj to yi is drawn. 

When there is no risk of confusion, we just write from now on just "ejj" to refer to an edge of the 
type efj, efj, or ef^-. 

Under this convention, a directed path V is a finite sequence of vertices, Vno,Vni ■ ■ -Vn^, such that 
each vertex appears at most once in the sequence and eij is an edge whenever Vj,Vi appear consecutively 
in the path. The integer L, is called the length of the path and it is denoted by L{V). By Vi, we denote 
the Vn^, the i + 1-th, vertex of the path V. A cycle, not necessarily directed, is a finite sequence of 



vertices Vno , Vm ■ ■ ■ such that Vno = ^^n^ and the constraint that either eij or Cji is an edge whenever 
Vi and Vj appear consecutively in the cycle. The sign of a cycle is defined as the product of the signs of 
the edges comprising it, and the sign of a path is defined to be the product of the signs of its edges. 

One of the main results in JH] is that an autonomous system (no inputs) is monotone with respect 
to some orthant if and only if its associated graph does not contain any negative cycles. An analogous 
result (basically with the same proof, which therefore we omit), holds for controlled systems: 

Proposition 4.1 A system which admits an incidence graph according to the above set of rules is 
monotone with respect to some orthants K, and K-^ if and only if its graph does not contain any 
negative cycles. □ 

Remark 4.2 We remark that in this set-up we deliberately restricted the class of systems for which 
the incidence graph is defined. In ^H] in fact the milder requirement that > for all x together 

with ^ > for some X is asked for in order to draw an edge between vertices Xj, Xj. This more general 
notion of incidence graph is however much more cumbersome to deal with if we want to give conditions 
for strong monotonicity of a system. □ 

This definition of incidence graph also provides the right set-up for easy geometrical characterizations 
of excitability and transparency; see j21j for systems with no inputs and outputs: 

Theorem 4 A monotone system which admits an incidence graph is excitable provided that each Xi 
is reachable through a directed path from any uj, and it is weakly excitable provided that each Xi is 
reachable through a directed path from some Uj, 

It is worth pointing out that for the special case of positive linear systems the above results are 
proven in jlOj . 

Theorem^ is proved in an Appendix. 

Similarly, we have: 

Theorem 5 A monotone system which admits an incidence graph is (weakly) transparent provided that 
directed paths exist from any Xj to any ( at least one ) output vertex yi . 

The proof of Theorem El is analogous to that of Theorem |5 and is sketched in an Appendix. 



5 Proof of Theorem [2] 

By Theorem^ we know that 

Xi > X2 k, Ui )^ U2 =^ f{xi,Ui) - /(X2,M2) G %i-x2K (6) 

where K is the positivity cone relative to the order y. Let us first show monotonicity of the feedback 
loop system. Recall that /i is a monotone map, i.e.: 

xi h X2 =^ h{xi) >z h{x2) (7) 



Therefore, if we combine © with ^ and we let ui = h{xi) and U2 = h{x2) we obtain 

xihx2 ^ f{xi,h{xi)) - f{x2,h{x2)) &Tx^-x2K (8) 
which, by Theorem 1 in [2j is equivalent to monotonicity of the closed-loop system: 

z = f{zM^))- (9) 
In particular then, if we denote by z{t, ^) the solutions of © we have as a consequence of monotonicity: 

ii^i2 ^h{z{t,ii))^h{z{t,i2)) vt>o. (10) 

Exploiting the fact that z{t,^) = x{t,S^,h{z {■,(,))) and (weak) strong transparency of we obtain: 

6^6 ^ h{z{t,^i)) = h{x{t,^i,h{z{;^i)))) » (>^) h{x{t,^2,h{z{;Cim 

h /i(x(t,6,/i(^(-,6)))) = M^(i,6)) vt>o. (11) 

Finally, by (|1H) and weak (strong) excitability: 

6^6 ^ /i(z(t,ei))»(^)M^(t,6)) 

^ z{t,^l)=x{t,Cl,Hz{;Cl))):^x{t,^2,Kz{;C2)))=z{t,^2) Vt>0 (12) 

as desired. I 

6 Monotone Linear Systems 

We recall next some basic facts about linear monotone systems which will be of interest in the discussion 
of the main result. 

Theorem 6 Let us consider the following finite dimensional linear system: 

x = Ax + Bu, y = Cx. (13) 

with X G M", u G M"*, y £MP and assume the state, input and output space equipped with some partial 
orders induced by the positivity cones , and respectively. 

System is a monotone control system with respect to the partial orders specified above if and 
only if: 

1. is positively invariant for the autonomous system x = Ax; 

2. BK^ C K^; 

3. CK^ c Ry. 

Proof. By the characterization of monotonicity in Theorem ^ a system is monotone if and only if: 

xi X2 k ui ^ U2 =^ A{xi - X2) + B{ui - U2) G %i_x2K'^ ^ (14) 
and the output map is monotone, i.e.: 

Xi ^ X2 ^ Cxi >z Cx2. (15) 
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In terms of positivity cones and denoting x := xi — X2 and u = ui — U2, conditions (|14() and 1)151) are 
equivalent to: 

xeK^ kueK^ ^Ax + Bue%K^ (16) 

and: 

X e ^ Cx £ K^. (17) 

Condition H17|) is clearly equivalent to assumption 3). Condition (jlbj) can be further decomposed by 
first taking arbitrary x and fixing u = and then x = and arbitrary u. Condition (|16|) therefore 
implies (and is in fact equivalent to, as we shall see later): 

x£K^ =^ Aie (18) 

and: 

ueK^ =^ Bue = K^. (19) 

The converse implication just follows by recalling that tangent cones of a convex set are closed under 
sums (since they are convex cones) and the following inclusion holds: C T^K^ for any x G 
Condition (|19j) is clearly assumption 2). Whereas condition (|18j) is the well-known characterization of 
positive invariance of under the flow x = Ax. I 



Corollary 6.1 The impulse response of a finite-dimensional, monotone, linear system (with respect to 
positive impulses) is a positive signal in output space: 

Ce^'BK^ C K^. 



□ 



The following fact, reviewed in an appendix, is a straightforward consequence of the Perron- Frobenius 
(Krein-Rutman) Theorem (see jS] pp. 6-8): 



Lemma 6.2 Assume that the linear system x = Ax admits a positively invariant convex (and proper) 
cone K. Then, there exists a dominant real eigenvalue A (i.e. an eigenvalue so that Re[Aj] < A for all 
i G 1,2, ... n), and a corresponding nonnegative eigenvector vx (positive and unique up to a positive 
multiple if A is irreducible) satisfies v\ ^ K. 



Remark 6.3 It is worth pointing out that for asymptotically stable single- input single-output mono- 
tone systems, the condition h{t) > 0, implies that the L^o induced gain equals the steady state 
gain. Recall that the steady-state gain of a linear system is just the slope of its I/O static characteristic. 
The 

-Loo — ^ Loo induced gain is instead defined as: 

l|y||oo 

7oo := sup 

u^O \\U\\oo 

where y{t) = y{t,0,u). It is well known (see 0, pg. 16) that 700 equals the Li norm of the impulse 
response. Thus, 

/•+00 f+00 
7oo = / \h{t)\dt= h{t)dt = -CA-^B. 

Jo Jo 

This last quantity equals k-^'{u) for any u, for linear systems. When the linear system in question is 
obtained by linearizing a nonlinear system about a steady state corresponding to an input uq, it equals 
k-^ (uo), where k-^ is the I/O characteristic of the original nonlinear system. □ 



The next technical lemma will be useful in order to study nonlinear monotone systems by linearizing 
the flow around an equilibrium position: 



Lemma 6.4 Let f : X x U ^ he a vector-field. Let f{x,u) = for some x € X and u ^U. If 
the flow induced by / is monotone with respect to some positivity cone the same holds true for the 
linearization at (x,m): 



z 
w 



df 
"Ux 

dh 



z + 



x=x,u=u 
- Z. 



df 



x=x,u=u 



(20) 



Proof. By one the results in j^, a system is monotone with respect to the positivity cones K (for states) 
and (for inputs) if and only if: 



xi y X2, Ui ^ n2 ^ /(xi,Ui) - f{x2,U2) G %^^^.^K. 



(21) 



Let z ^ K , V ^ be arbitrary and, for any e > 0, := ez + x, = ev + u. By ^21\ applied with 

Xi = Xe, X2 = X, Ui = Ue, and U2 = u, 



f{x„u,)/s€%,iK) = %K. 
By letting e tend to and exploiting closedness of the tangent cone we have: 



df 

ox 



x=x,u=u 



Z+^ 

du 



V G %K. 



(22) 



(23) 



x=x,u=u 



Let, for simplicity A= ji- 



x=x,u=u 



and S = |{ 



. By linearity, there follows easily: 



x=x,u=u 



ZlhZ2 , VihV2 {Azi + Bvi) - {AZ2 + BV2) G %^-z,,K. 



(24) 



This concludes the proof of the claim, by exploiting once more the characterization of monotonicity in 

U- ■ 

We remark that for the special case of being positive orthants the result was already proved 

in Section 8, [21 ■ 



Lemma 6.5 Consider a monotone system with a non-degenerate I/S static characteristic k^{ )- For 
each u the corresponding equilibrium k^{u) is hyperbolic. 



Proof. By Lemma 16.41 the linearized system at the equilibrium is monotone. Therefore it admits a real 
dominant eigenvalue A. By asymptotic stability of the nonlinear system and non-degeneracy, A < 0. 
Thus for all eigenvalues Aj of Dxf{k^{u),u) we have Re[Aj] < A < which completes the proof of our 
claim. I 

The following key fact establishes a relation between steady-state responses and stability under 
unity- feedback, for monotone linear systems. 



Lemma 6.6 Suppose that the linear system z = Az + Bu, y = Cx is monotone, where inputs and 
outputs are scalar and are endowed with the standard order in M, the matrix A is Hurwitz (all eigenvalues 
have negative real parts), and CA~^B 7^ —1. Then, the following two properties hold: 



Q 



1. CA ^i?<— lif and only if every eigenvalue of A + BC has negative real part. 

2. CA^^B > — 1 if and only if there is an eigenvalue of A + BC with positive real part. 

Proof. We start by noticing that the closed-loop system z = {A + BC)z is monotone, since monotonicity 
is preserved under positive feedback, as shown in the first part of the proof of Theorem [3 Therefore, 
the matrix A + BC admits a real dominant eigenvalue A, i.e. an eigenvalue so that A > Re[Ai] for all 
eigenvalues Aj oi A + BC, and there is a corresponding eigenvector: 

{A + BC)v = ~Xv (25) 

with V € = K. By choice of A, the condition A > (respectively A < 0) is equivalent to there 
existing some eigenvalue of ^ + BC with positive real part (respectively, all eigenvalues have negative 
real part). 

We now multiply both sides of (|25j) by CA^"^, and obtain: 

A {CA-^v) = {Cv) [1 + CA-^B] . (26) 

Note that A 7^ 0. Otherwise, if A = 0, Equation fl^ together with the fact that CA~^B ^ —1, would 
imply that Cv = 0, and hence Av = (A + BC)v = Au = 0, which would mean that A is singular, 
contradicting the nondegeneracy assumption on steady states. Thus, we know that A 7^ and that 
1 + CA-^'B / 0. So we must show that 1 + CA'^'B > iff A < 0. 

We know that Cv > 0, by Property 3 in Theorem |H1 and 

/■+00 

CA-^v = - I C dt < 0, (27) 







where the integral in (|27j) converges as A is Hurwitz. If Cv > 0, then CA~^v < 0, and hence (|26|) gives 
that 1 + CA~^B > iff A < 0, as wanted. So, we must only treat the case Cv = 0. We do this next, by 
means of a perturbation argument. 

Since K is a pointed cone, there is some vector p € M" with the property that {p, v) > for all 
V e K\{0} (see e.g. [20], Theorem 3.3.15). For each e > 0, let Q := C + ep'. Note that C^v > 
for aW V K \ {0}, because of the choice of p and because Cv > 0. Moreover, by continuity on e, for 
all e small enough (assumed from now on), CirA~^B 7^ —1. Thus, we may apply the previous proof to 
the system described by {A, B, Cg) (note that the vector v picked in the proof belongs to K\ {0}). We 
conclude that, for all small e > 0, 

1 + CeA-^B > Ae < 

where A^ is the dominating eigenvalue of ^ + BCs- We have that 1 + CsA~^B — > 1 + CA~^B and, by 
continuity of eigenvalues on matrix entries (e.g.. Appendix A. 4 in '30"), also A^ ^ A as e \ 0. The 
result then follows by taking limits and recalling that we know that A 7^ and 1 + CA~^B 7^ 0. I 



7 Proof of Theorem [HI 

Let : U ^ X denote the I/S static characteristic and let u be any solution of u = h{k^ {u)). Clearly, 
f{k-^{u),h{k^{u))) = f{k^{u),u) = and therefore x := k^{u) is an equilibrium of the closed-loop 



in 



system. Conversely, let x be an equilibrium; the corresponding output value satisfies y = h{x). As in 
closed- loop u = y, we have x = k^{y). Thus y = h{k^ (y)), as desired. 

The characteristic is a differentiable function. Indeed, we have that k^ (u) solves f{k^{u),u) = 0, 
and the nondegeneracy assumption says that the partial derivative of f{x,u) with respect to x is 
invertible at k^{u), for each u; by the Implicit Mapping Theorem, it follows that k^ is differentiable. 
Moreover, we can compute its derivative by differentiating: 



Evaluating the above expression at u = u yields k'^{u) = - 

8h 



0. 

A~^B and so 



-CA-^B. 



where A, B, and C are defined as: 



A 



dl 

dx 



B 



x=k-^ (u),u=u 



dl 

du 



C 



x=k-^{u),u=u 



dh 
dx 



and A ^ exists by non-degeneracy of the I/S characteristic. (Note that this gives,, in particular, that 
the induced gain of the linearized system (|^n|) is 700 = k'y{u), by Remark 16. HI ) 

Next, we turn to the relation between stability and the slopes of the I/O characteristic at equilibria. 
The closed-loop linearized system which arises by linearizing the nonlinear system ^ together with 
the unitary feedback interconnection u = y is precisely the same as the system that results if we first 
linearize ©, obtaining i = Az + Bu, y = Cz (which is itself monotone by virtue of Lemma l6.4|) . and 
then apply unitary feedback to obtain i = (A + BC)z. Note that j4 is a Hurwitz matrix, by Lemma 16.51 
Also, CA~^B ^ — 1, because ky{u) 7^ 1 (nondegenerate characteristic). Thus, we may apply Lemma [6.6l 

In particular, equilibria with ky{u) < 1 are locally asymptotically stable and equilibria with k'y{u) > 1 
have a nontrivial unstable manifold. By Hirsch's Theorem on generic convergence of strongly monotone 
flows (see ^Zj, Section 7), for almost all initial conditions, solutions will converge to the set of equilibria. 
Moreover, by Remark 17.31 below, the stable manifolds of (exponentially) unstable equilibria have zero- 
measure. Therefore, for almost all initial conditions, solutions converge to the set of points where 
ky{u) < 1. This completes the proof of our result. I 

Remark 7.1 It is worth pointing out that, whenever the equilibrium in Theorem |31 is unique, conver- 
gence to the equilibrium is global under mild assumptions of convexity and location of omega limit sets 
in the interior of the state-space; see Theorem 3.1 of [2ZI- D 

Remark 7.2 An alternative proof, based on frequency domain considerations, of the connection be- 
tween stability of the closed- loop equilibrium and the I/O characteristic is provided next. 

Consider the transfer function 



w{s) = / h{t)e'''dt 
Jo 



of a strictly proper linear system, and let 



1 — w[s) 



be the transfer function of the associated unity-feedback closed-loop system. Suppose: 
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1 



h is integrable (so, w has no real nonnegative poles); 



2 



h{t) > for all t > (and is not identically zero); 



3 



w^O) 7^ 1 (transversality condition). 



Then: 



(a) there exists a positive real pole of Wd if and only if 'w{0) > 1; 

(b) every real pole of Wd is negative if and only if ri;(0) < 1. 

Proof: By the first assumption, w{X) is a continuous (real-valued) function for A > 0. 

Furthermore, h{t) > for alH > and not identically zero implies that w'^X) = — h{t)te~^^dt < 
for all A, so w is a strictly decreasing function of A. 

Nonnegative real poles of Wd are exactly those A > such that w{X) = 1. 

If w{X) = 1 for some A > then the strict decrease of w implies that wi^O) > 1. Conversely, suppose 
that w{0) > 1. By strict properness, w{X) — > as A — > +00. Thus there is some A > such that 
w{X) = 1. This proves (a). 

The first conclusion may be restated as: "every pole of Wd is < if and only if w{0) < 1" so, since we 
know in addition that w{0) 7^ 1, this is the same as requiring that every real pole is (strictly) negative. 
Thus (b) holds too. □ 

Remark 7.3 Stable manifolds of (exponentially) unstable equilibria have zero-measure. In the non- 
necessarily hyperbolic case, this fact is an easy consequence of Theorem 2.1 in [H] (modified as discussed 
in the remarks following Theorem 2.1, including the choice of suitable norms and the multiplication by 
a "bump" function, after a linear change of coordinates, and specialized to r = 1, and applied to time-1 
maps). □ 

Remark 7.4 A precise characterization of the basin of attraction of each asymptotically stable equi- 
librium is of course not possible in general; on the other hand, it is a straightforward consequence of 
monotonicity of the I/S characteristic that equilibria are ordered, ei ~< 62 ~< 63. It therefore makes sense 
to speak about intervals [61,62] := {x € X : ei ^ x ^ 62}. Again, it is a straightforward consequence 
of monotonicity that intervals [61,62] with 61, 62 equilibria are positively invariant. This allows to give 
estimates of the basin of attraction of each equilibrium. In the case of 3 equilibria for instance, with 
61 ^ 62 ^ 63 and 61, 63 asymptotically stable, 62 unstable, we can conclude that {x : x <C 62} C ^1 and 
{x : X ^ 62} C ^3. Similar considerations, based on empirical evidence, are made for instance in 
It is therein pointed-out how the unstable equilibrium plays the role of a threshold. □ 

8 Examples 

A typical situation for the application of Theorem |31 is when a monotone system with a well-defined 
I/O characteristic of sigmoidal shape is closed under unitary feedback. If the sigmoidal function is 
sufficiently steep, this configuration is known to yield 3 equilibria, 2 stable and 1 unstable. In biological 
examples this might arise when a feedback loop comprising any number of positive interactions and an 
even number of inhibitions is present (no inhibition at all is also a situation which might lead to the same 
type of behavior). This is a well-known principle in biology. One of its simplest manifestations is the so 
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called "competitive exclusion" principle, in which one of two competing species completely eliminates 
the other, or more generally, for appropriate parameters the bistable case in which they coexist but 
the only possible equilibria are those where either one of the species is strongly inhibited. As a simple 
example, consider the system described in |13| . used there to describe a model of gene expression. The 
systems equations are as follows: 

Xl = - X\ 

(28) 



x-i 



1+^ 



X2 



where ai,a2i/3)7 are some positive constants. This can be seen as the unitary feedback closure of: 



x\ 

Xl 

y 



a2 



1+= 
X2. 



Xl 
X2 



(29) 



Equation ()29() is a monotone dynamical system with respect to the order induced by the positivity cone 
K := M<o X ]R>o- It is straightforward by a cascade argument to see that the system is endowed with 
the following static I/S characteristic: 



fc^(n) 



In Fig. ^we plotted the I/O static characteristic for ai = 1.3, 02 = 1, P = 3 and 7 = 10. (The value 




Figure 1: I/O characteristic and phase plane. Horizontal axis is u (resp., xi) and vertical axis is X2- 

7 = 10 was chosen only in order to help visualize the sigmoidal form of the characteristic, and similar 
results hold for a smaller and more biologically realistic constant.) As confirmed by a sketch of the 
phase plane, for almost all initial conditions, trajectories converge to the equilibria where the derivative 
condition is satisfied. 

Of course, the interest of our results is in the high-dimensional case in which phase-plane techniques 
cannot provide the result, and we turn to such an example next. However, let us note that, for the 
special case of two-dimensional systems, our techniques are very close to those of (Tj. In fact, even the 
4-dimensional example of a two-repressor system with RNA dynamics, treated in 171 (Appendix I) in 
an ad-hoc manner, can be shown to be globally bistable as an immediate application of our techniques. 

We now turn to a less trivial example where our tools may be applied. (A different example, 
involving cascades of systems of this type, and with comparisons with experimental data, is treated 



1.^ 



in pp.) Consider the following chemical reaction, involving various forms of a protein E: 

El ^ E2 ^ • • • ^ E„_i ^ En 

being driven forward by an enzyme U, with the different subscripts indicating an additional degree of 
phosphorylation, and with constitutive dephosphorylation. We will be interested in positive feedback 
from E„ to U. 

A typical way to model such a reaction is as follows. We introduce variables Xi{t), i = 1, . . . ,n to 
indicate the fractional concentrations of the various forms of the enzyme E (so that xi + . . . + = 1, 
and Xi > 0, for the solutions of physical interest), and u{t) > to indicate the concentration of U. The 
differential equations are then as follows: 

Xl = -ai{u)ai{xi) + P2{x2) 

±2 = cFi{u)ai{xi) - I32{x2) - (T2{u)a2{x2) + (^■iixz) 

Xn-l = (Jn~2{v)an-2{Xn--2) " l3n-l{Xn-l) " fT„_i (n)a„_i (x„_i) + /?„(x„) 
Xn = (Tn~l{u)an-l{Xn-l) - l3n{Xn) ■ 

We make the assumptions that ai and [3i (respectively, ai) are differentiable functions [0, 00) — > [0, cxo) 
with positive (respectively, either positive or identically zero) derivatives, and ai(0) = /3i(0) = and 
(Ti(0) > for each i. (We allow some of the Uj to be constant, and in this manner represent steps that 
are not controlled by U.) Since we are interested in studying the effect of feeding back E„, we pick 
y = Xn- 

Let us first prove that the characteristic is well-defined. As we said, we are only interested in the 
solutions that lie in the intersection X of the plane xi + . . . + x„ = 1 and the nonnegative orthant in 
M". This set is easily seen to be invariant for the dynamics, and it is convex, so the Brower fixed point 
theorem guarantees the existence of an equilibrium in X, for any constant input u[t) = a. We next 
prove that this steady-state is unique. Redefining if necessary the functions Oj, we will assume without 
loss of generality that (Ti{a) = 1 for all i. Let us introduce the nondecreasing functions 

Fk = o ak-i o (3~\ o . . . o (3~^ o ai 

for each k = 2, . . . , n and F{r) := r + F2{r) + . . . -\- Fn{r). This function is defined on some maximal 
interval [0, M], consisting of those r such that ai(r) belongs to the range of P2, tt2(/32~^('^i (''))) belongs 
to the range of P3, and so forth, and it is strictly increasing. Moreover, for each equilibrium x = 
(xi, . . . , Xn), it holds that x^ = Ffc(xi), and therefore, recalling that xi + . . . + Xn = 1, F{xi) = 1. Thus, 
if X and x are two steady states, we have F{xi) = F{xi). Since F is strictly increasing, it follows that 
Xl = Xl, and therefore that Xk = Fk{xi) = Fk{xi) = Xk for all k, so uniqueness is shown. 

We must prove stability. For that, we first perform a change of coordinates: 

Zl = Xl, 2:2 = Xl + X2, . . . , Zn-1 = Xl + . . . + X„_i, Zn = Xi + . . . + Xn 

SO that the equations in these new variables become (using that = {d/dt){xi + . . . + x^) and Xk = 
Zk - Zk-i for k>l): 

Zl = -ai{u)ai{zi) + (32{z2 - Zl) 

Zk = -cFk{u)ak{zk - Zk-i) + I3k+i{zk+i - Zk) 

Zn-1 = -an-l{u)an-l{Zn-l - Zn-2) +/?«(!- ^n-l) 



(and Zn = 1). When the input u{t) is equal to any given constant, the system described by the first 
n — 1 differential equations, seen as evolving in the subset of M""-*^ where < zi < Z2 < . . . < Zn-i < 1, 
is a tridiagonal strongly cooperative system, and thus a theorem due to Smillie (see [201) insures that all 
trajectories converge to the set of equilibria. (The proof given in [2HI is also valid when the state-space 
is closed, as here.) Moreover, linearizing at the equilibrium preserves the structure, so applying the 
same result to the linearized system we know that we have in fact an exponentially stable equilibrium. 
Thus, characteristics are well defined. 

It is easy to verify from our graph conditions that the system (in the new coordinates) is monotone, 
since dfi/dzj > for all pairs i ^ j, dfi/du < for all i, and dh/dzi = for alH < n — 1 and dh/dz^^i < 
(the output is y = x„ = 1 — Zn-i)- Excitability and transparency need not hold at boundary points; 
however. Theorem El still applies, because the closed-loop system is strongly monotone. To see this, 
it is enough to show that every trajectory lies in the interior of X for all t > 0, since in the interior, 
the Jacobian matrices are irreducible. As the interior of X is itself forward invariant (see e.g. |2J), it is 
sufficient to prove: for any T > 0, if F is the set of t G [0,T] such that x{t) is in the boundary of X 
(relative to the linear space xi -|- . . . -|- a;„ = 1), then F / [0, T]. Assume otherwise. For each i, consider 
the closed set Fj = {t G [0, T] | Xi{t) = 0}, and note that Ui -^j = ^- If would be nowhere dense 
for every i, then their union F would be nowhere dense, contradicting F = [0,T]. Thus there is some 
i so that Fi contains an open interval (a, 6) C [0, T]. It follows that, for this i, Xi = Xi = on (a, 6), 
and (looking at the equations) this implies that Xi±i = and, recursively, we obtain xj = for all j, 
contradicting xi + . . . + Xn = ^■ 

As a numerical example, let us pick crj(r) = (0.01 -|- r)/(l -|- r), ai{r) = 10r/(l -|- r), and /3j(r) = 
r/(l -|- r) for all i, and n = 7. (The constants have no biological significance, but the functional forms 
are standard models of saturation kinetics.) A plot of the characteristic is shown in Fig. |2{a). Since 
the intersection with the diagonal has three points as shown, we know that the closed-loop system (with 
u = Xn) will have two stable and one unstable equilibrium, and almost all trajectories converge to one 
of these two stable equilibria. To illustrate this convergence, we simulated six initial conditions, in each 
case with 2:2(0) = . . . = xq(0) = and with the following choices of Xf{0): 0.1, 0.2, 0.3, 0.4, 0.5, and 0.8 
(and xi(0) = 1 — 2:7(0)). A plot of xjlt) for each of these initial conditions is shown in Fig. |21^b); note 
the convergence to the two predicted steady states. 



9 External Stimuli, Thresholds and Hysteresis 

Throughout this section we investigate the behavior of positive feedback interconnections of monotone 
systems which are in turn excited by some exogenous input. In particular we consider interconnections 




Figure 2: Enzyme example: (a) Characteristic and (b) Simulations 



of the following type: 

X = f{x,u,v) 

y = hy{x) (30) 
w = hw{x) 

along with the unitary feedback interconnection u = y. The block diagram of such systems is shown in 
Fig. El 



V 




w 


u 








y 









Figure 3: Block diagram of unitary feedback system with external inputs 

We assume f : X x U x V ^ M" to be a locally Lipschitz function and that the system (|3flj) is a 
monotone control system with input [u, v] and output [y, w] with respect to some ordering of the 
state-space X and cross-product orders as far as inputs [u, v] and outputs [y, w] are concerned, (i.e. 
[ui,vi] hi [u2,V2] iff ui hu U2 and vi hv V2, [yi,wi] ho [y2,W2] iff yi hy y2 and wi hw ^2)- 

For each fixed value of the input v, systems as in (|nn|) can be studied according to the techniques 
described previously. 

A special instance of systems of this kind is given by single-input, single-output systems of the 
following form: 

X = f{x,d) 

d = g{v,y) (31) 

y = Kx) 

where g : V x U ^Risa monotone and locally Lipschitz function (for instance u,v £ M>o and 
g{v,y) = vy or g{v,y) = v + y). This structure (see Fig. 0]) is of interest because it arises commonly in 
biological applications and is particularly suited for a graphical analysis. 



u 



9i-r) 



d 



y = w 



Figure 4: A special feedback configuration of SISO systems 

Next, we discuss the behavior of such interconnections in the presence of external stimuli. In 
particular, in the case of multistable systems we prove the existence of threshold values of inputs which 
trigger the transition among different equilibria. 

The above considerations suggest the possibility of studying interconnections as in (PU)) by taking 
into account a parametrized family of I/O static characteristics in the {u, y) plane, where the parameter 
is the exogenous input v. This type of analysis is very general and bifurcations can be traced by 
looking at the intersections of the parametrized I/O characteristic with the diagonal u = y. For the 
special structure Q) instead, the study can be carried out in the (d, y)-plane allowing some intuitive 
simplifications. A single I/O characteristic is needed in fact, from d to y, and equilibria correspond 



to intersections with the "parametrized" family of functions d = g{v,y), which also takes values in 
the (d, y) plane. Although the analysis which follows is essentially a consequence of Theorem |31 it is 
still worth pursuing, because it provides a solid theoretical justification to phenomena which are well 
described and understood in many biological applications. Consider again the system ()29() . subject to 
the feedback interconnection u = v ■ y. This results in the following set of equations: 

X2 = (32) 

y = 

We may therefore analyze the system by looking at the I/O static characteristic from u to y, together 
with the u-parametrized family of lines y = u/v. Fig. El illustrates a typical situation, corresponding 
here to the parameters value in the following table: 



7 


6 




3 


ai 


1.3 


Q!2 


1.3 



Notice that for v = 1 bistability is obtained; in particular two equilibria are asymptotically stable and 
one is an unstable saddle whose stable manifold behaves as a separatrix for the basins of attractions 
of the stable equilibria. Bifurcations occur at two different values of v, approximately vi ~ 0.8 and 
V2 ~ 1.35. This values correspond to the slopes of the tangent lines to the I/O characteristic. For all 

V > f 2 in fact there only exists one equilibrium, usually referred to as the activated equilibrium. For 

V < vi again only one equilibrium occurs but corresponding to a non-activated state. These values 
play therefore the role of input thresholds that may trigger transition from the non-activated state to 
an activated one and vice versa. After a signal of amplitude bigger than V2 is applied for a sufficiently 
long time, the state will be in proximity of the activated equilibria. Then, this level of output will 
be maintained even after v{t) drops below V2, provided that vi < v{t). Further decrease of the v{t) 
below vi, for a sufficiently long time, will instead trigger transition to a deactivated state, which is 
afterward maintained also for higher values of v{t), provided that v{t) < V2- This kind of behavior, 
known as hysteresis, has been observed in many biological systems (see for instance [2S|)- In an 
actual experimental situation, one would block the feedback of X2, replacing the effect of X2 by an 
experimentally set value of the input, and the bifurcation diagram would be obtained directly from the 
I/O characteristic, itself measured experimentally. See pi for more discussion of this topic. 




Figure 5: Thresholds and hysteresis; horizontal axis is u (resp. v) and vertical axis is X2- 
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10 Why is Monotonicity Imposed ? 



Local analysis techniques based on the study of intersections of static characteristics of interconnected 
systems or, in the two-dimensional case of nullclines, are very common in mathematical biology. Our 
discussion shows that for the class of monotone systems, under relatively mild assumptions, almost 
global convergence results can be obtained and the investigation of the stability property of equilibria 
can be carried out just by graphical inspection at the intersection points of the I/O characteristics of 
systems in feedback. In this section we show by means of an example how monotonicity is a crucial 
assumption in this respect. The following planar system (a predator-prey system): 

Xl = Xl{-Xl+X2) 

X2 = 3x2{-xi + u) (33) 
y = c + bj^^ 

evolving in M^q, it is not monotone. However, it has a well defined (monotonically increasing) I/O 
static characteristic (see Fig. inj provided that c,b,k G M>o- Moreover, for certain parameters values, 
the I/O characteristics has 3 (non-degenerate) fixed points. The closed- loop system resulting from the 
interconnection u = y, however, need not be globally converging at the set of equilibria. The simulations 
in Fig. IHl refer to the following values: c = 1.1,6 = 361/140, A; = 405/14. Notice that the 3 equilibria 
correspond to 2 unstable foci and one saddle point. 




Figure 6: A stable limit cycle arising in a non- monotone feedback loop and the I/O static characteristic; 
horizontal axis is xi (resp. u) and vertical axis is X2 (resp. y) 



11 Conclusions 

We have presented a general method for detecting multistability in a class of positive feedback sys- 
tems. Our results apply when the original system has certain properties (well-defined characteristic, 
monotonicity). The results can be used in conjunction with other techniques being developed, such as 
the study of small-gain theorems for negative feedback interconnections (cf. [21), in order to attempt 
to understand the behavior of complex biological signaling interconnections by first breaking up the 
system into smaller parts and then reconstituting the behavior of the entire system. 
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A Graphical characterizations of Transparency and ExcitabiUty 



Lemma A.l Consider a scalar differential equation x = f{x, u), evolving on a open subset of M, where 
u = (ui,U2, . . . ,Uk) is a vector of input functions uj taking values in nonempty sets Uj Q M. We assume 
that / is and that solutions are defined for all initial states and all t > 0, for any locally bounded 
inputs. Suppose that the system is cooperative, that is, f{x,u) is nondecreasing as a function of uj, 
for all j (meaning that, for every x, f{x,u) > f{x,v) if Uj > Vj for all j). Define the following set of 
indices: 

/+ := {j* G {1, . . . , A;} I f{x, u) is strictly increasing as a function of uj*} 

(the strict increase condition meaning that f{x,u) > f(x,v) for all x,u,v such that Uj > Vj for all j 
and Uj* > Vj*), and, for each j S {1, . . . , k}, each e > 0, and each pair of inputs u{-) and v{-), the set 
of times: 

Sj,e,u,v ■■= {t G [0,e] I Uj{t) > Vj{t)} 

(possibly empty). Pick any two inputs u(-) and v{-) such that u'^v (i.e, Uj{t) > Vj{t) for all t and all 
j) and suppose that either: 

1. there is some j* G /+ is such that the Lebesgue measure fi {Sj*^s,u,v) > for each e > 0, or 

2. u y V and /+ = {1, . . . , k}. 

Then, for each initial state ^, the respective solutions for these two inputs satisfy x(t, ^, u) > x(t,^,u) 
for all t > 0. 

Proof. Take two such inputs and initial state. Since the system is monotone, we know that x{t,^,u) > 
x{t, ^, v) for all i > 0, but we need to prove that the strict inequality holds for all t. So suppose that 
there is some T > such that x{T, ^, u) = x(T, ^, v) = C- 

We claim that, then, x(s,^, u) = x{s,(,,v) for all s < T. This fact is an easy consequence of 
comparison arguments based upon monotonicity (see [231 )• We provide a proof here for the reader's 
convenience. Suppose that ^' = x{S,S,,u) > x{S,^,v) = ^" for some S <T, and consider the following 
system of two differential equations: 

X = f{x,u) 
z = f{z,v)- 

Pick a sequence {ak,bk) — > (CjC) with the property that Ofc < bj. for all k (for instance, bk = C ^"^^ 
Ok = C ~ 1/^ for ^ large enough). Let $ be the map that sends initial states {x{S), z{S)) at time S 
into states {x{T,x{S),us), z{T, z{S),vs)) at time T, where us and vs are the inputs restricted to times 
> S (we may think of ^ as the time T — S flow of the two-dimensional system). As this map is a 
diffeomorphism, there exists a sequence {ck,dk) — > such that $(cfc,dfc) = {ak,bk) for all k. Since 

^' > it follows that Ck > dt for some k. This means that the solution of the above system, with 
initial state x{S) = > = z{S) satisfies x{T) < z{T), contradicting the monotonicity of the original 
system. 

Since x(s) = x(s,^,u) = x{s,S,,v) for all s < T, we may take derivatives with respect to time to 
conclude that 

f{x{s),u{s)) = f{x{s),v{s)) 

for all s G [0,r]. 

1Q 



Suppose that there is some j* G /+ so that ^ {Sj*^T,u,v) > 0. Then we may pick a time t G St so that 
Uj*{t) > Vj*{t) and also f{x{t),u{t)) = f{x{t),v{t)). This contradicts the strict increase assumption 

Suppose instead that u >- v. Then, we claim, there is some j* such that /u {Sj*^e,u,v) > for all e > 0. 
Indeed, if this claim were false, then there would be for each j some ej > such that /U {Sj^£.^u,v) = 0, 
which implies that also ^i{Sj^ir^u,v) = 0, where e = minej. Thus the union of these sets has measure 
zero, that is, Uj{t) = Vj{t) for all j and all t G [0,e], contradicting u y v. Since j* € {1, • • • ,m} = /+, 
we have reduced to the first case. I 

For one-dimensional systems, Theorem 0] can be strengthened into a necessary and sufficient state- 
ment. The proof of the Theorem will recursively use this result. 

Corollary A. 2 Let i = /(x, u) be a scalar cooperative system as in Lemma lA.ll and assume that this 
system has a well-defined incidence graph. Then, the system is excitable if and only if /_|_ = {1, . . . , k}, 
and it is weakly excitable if and only if /-|_ 7^ 

Proof. Suppose that /_|_ = {1, . . . , k}, and pick any two inputs u >- v. The second case in the Lemma 
then gives that x{t, ^, u) > x{t, ^, v) for all t > 0, and this proves excitability. If, instead, v and we 
know that ^ 0, we pick any j* E and use the fact that v implies that Sj*^fr^u,v = [0, e] for all 
e, so the first case in the Lemma then gives that ^, u) > x{t, ^, v) for all t > 0, and this proves weak 
excitability. 

To prove the converse implications, we first consider the case /+ = 0. By definition of incidence 
graph, this means that ^{x^u) = for all j. Thus, solutions do not depend on input signals, and 
this contradicts weak excitability. If, instead, we only know that some j* ^ /+, then we have that 
= 0, and we may take any initial state ^, and any two inputs u{-) and v{-) with the property 

that Ui{t) = Vi{t) for all t and all I 7^ j*, and Uj*{t) > Vj*{t); since a;(-,^,u) = x(-,^, f), we have that 
uy V but it is false that x{t,(,,u) > x{t,^,v) for t > 0, contradicting excitability. I 



Proof of Theorem |^ 

By appropriate coordinate changes Xi 1— > {—lY^Xi, as done in one may restrict attention to cooper- 
ative systems. 

Consider a cooperative system which admits an incidence graph and assume that each vertex Xi is 
reachable from some input vertex uj. Let ^ be an arbitrary initial condition and let u, v be arbitrary 
input signals satisfying v ^ u. We know that x{t, ^, v) >: x{t, ^, u) for all t, and must show the 
strict inequality for all state components, i.e., x(t,(,,v) » x{t,S,,u). We will prove this by induction, 
exploiting repeatedly Lemma I A. II To this end, we decompose the system in sublayers, based on the 
following notion of distance among vertices of a graph: 

d{v — > If) = min{L(V) : Vq = v and Vl = w}, (34) 

i.e. d{v — > w) denotes the shortest length among all paths which link v to w. Furthermore, for each 
state vertex Xi of the incidence graph, we define the following integer: 

D{xi) = inf d{uj — > Xj) (35) 

(in words: D[xi) corresponds to the minimum distance from some input vertex Uj to the state vertex 
Xi). Notice, by the reachability assumption, that D{xi) is well-defined (< +00) for every i G {1, . . . n}. 
We say that Xj belongs to the k-ih sublayer, if D{xi) = k. 
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Consider any state coordinate Xi so that D{xi) = 1 (such a coordinate always exists). We view 
Xi = fi{x, u) as a scalar (cooperative) system, forced by the inputs u and Xk for all k ^ i. As D{xi) = 1, 
there exists j* such that fi{x,u) is strictly monotone as a function of uj*. Since v, Vj*{t) > Uj*{t) 
for almost all t > 0. Then the first part of Lemma I A . II allows us to conclude that Xj(t, ^, v) > Xi{t, ^, u) 
for all t > 0. This shows that the strict inequality holds for all state components belonging to the first 
sublayer. 

Proceeding by induction, any component belonging to the i-th sublayer is reachable in one step 
from at least some component Xj belonging to the {i — l)st sublayer (strict monotonicity of fi{x, u) with 
respect to xj), and once again viewing Xi = fi{x,u) as a scalar (cooperative) system, this time using 
Xj{t) as the input, we conclude that Xi{t,S^,v) > Xi{t,(^,u) for all t > 0. 

This completes the proof for the case of weak excitability. Next we consider the case of excitability. 

Assume that v >- u. Arguing as in the proof of Lemma lA. 11 we know that there exists an integer j* 
so that II {Sj*^e,u,v) > for each e > 0. We again prove the result by induction by considering a sublayer 
decomposition, this time taken by looking at graph distances with respect to this particular input vertex 
j*, i.e.: D{xi) := d{uj* Xi). By the reachability assumption in the case of weak excitability, D{xi) is 
well-defined for all i € {1, 2, . . . n}. 

Pick any state component Xi for which D{xi) = 1. Once again, we view Xj = fi{x,u) as a scalar 
cooperative system, forced by the inputs u and Xk for all k ^ i. In particular fi{x, u) is strictly monotone 
with respect to uj* , and we may apply the Lemma. Arguing by induction, any component belonging to 
the i-th sublayer is reachable in one step by some component belonging to the (i — l)st sublayer, and 
therefore a similar argument applies, yielding Xi{t,S^,v) > Xi(t,(,,u) for all t > 0. I 

Sketch of Proof of Theorem |5] 

Consider an arbitrary pair of ordered initial conditions >- ^2- By monotonicity and uniqueness of 
solutions, we have x(t,(,i,u) >- x{t,^2,u) for all t > 0. Arguing as earlier, we know that there must 
exist some index j* so that, for all e > 0, the set {t € [0, e] | Xj*{t,(,i,u) > Xj*{t,^2,u)} has non-zero 
measure. 

We claim that Xi{t,(^i,u) > Xi{t,£^2iu) for every vertex Xi which is reachable from the vertex xj*, 
and denote with TZj* the set of such XjS. The claim can be shown inductively by an argument analogous 
to the one employed in the proof of Theorem 0] 

By the graph reachability condition (either weak or strong), for all (some) output vertices yj there 
exists at least one Xi G TZj* so that Xi — > yj is an edge of the incidence graph. Thus, hj{x{t,(^i,u)) > 
hj{x{t,$,2,u)) for alH > for all such js. I 

B Proof of Lemma 16.21 

Proof. Consider the exponential map ^ — >■ e^*^. By positive invariance of K, for each t > the 
exponential is a linear map from K to K. Moreover, for t sufficiently small t, t ^ e'^t is one-to-one on 
the spectrum of A. Thus, by Lemma A. 3. 3 in |301, the geometric multiplicity of C*"'* as an eigenvalue 
of the exponential map is the same as that of Aj as an eigenvalue of A, with the same respective 
eigenvectors. Therefore, we can study the spectrum of A by looking at the spectrum of its exponential 
map for t sufficiently small. By the Perron-Frobenius Theorem, there exists a real positive eigenvalue 
//, with eigenvector v G K, which is dominant in the sense that // = /^(e^*) (eigenvalue of maximum 
modulus). Therefore, we conclude that A := log(;u)/t is an eigenvalue for A, relative to the same 
eigenvector v & K, and Re(A) > Re(Aj) for all Aj € Spec(j4). I 
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